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ABSTRACT 

Recent developments in dichotomous factor analysis 
based on multidimensional item response models (Bock and Aitkin, 
1981; Muthen, 1978) provide an effective method for exploring the 
dimensionality of questionnaire items. Implemented in the TESTFACT 
program, this "full information** item factor analysis accounts not 
only for the pair wist joint frequencies of correct/incorrect 
responses, but also for additional information in higher order joint 
frequencies in the sample of dichotomously scored items. This paper 
illustrates this method's utility by analysing a questionnaire on 
affective outcomes of schooling using the expected a posteriori (SAP) 
method of estimating ability scores. The 40 item questionnaire with 
four subscales (Punctuality, Honesty, Cooperation, and Curiosity) was 
developed to measure a set of potential outcomes of schooling's 
"latent curriculum". A stepwise full-information item factor analysis 
was performed on data from 700 elementary school students Which 
identified-tftroe-factoxsx interpersonal relations, active 
participation, and studious attitude. The advantages of using SAP 
scores over the use of raw scores to simplify the interpretation of 
multivariate analysis of variance where there are fewer concepts to 
discuss are illustrated. The full information factor analysis is 
strongly recommended for construct validation in the initial 
preparation stage of item construction for psychological /measuremnt. 
(BS) 
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Recent developments in dichotomous factor analysis based on 
multidimensional item response models (Bock and Aitkin, 1981; 
Muthen, 1978)/ provide an effective method for exploring the 
dimensionality of questionnaire items. The purpose of this paper 
is to illustrate the utility of this method for item factor 
analysis in three sets of data. The first two sets are 

* j 

simulated, and the third set is an analysis of a questionnaire 
on affective outcomes of schooling (Engelhard, 1985). 

Description of the Item Factor Analysis Model 

In adapting Thurstone^ multiple factor model to 
dichotomous data, Bock and Aitkin (1981) consider the response 
process, y^ , of subject i and item j to be a linear .combination 
of m normally distributed latent variables, e , weighted by the 
factor loadings, a ; t*hat is, 

y ij ■Vli +a j2 6 2i + - ' ' + Vmi + Vj (1) 

For a randomly sampled subject, it is assumed that 8 , z and 1 
are multivariate normalt 

6 ~N(0,I) (2) 
2^(0,1) (3) 
A^N(0,D o ) (4) 
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Assumptions (2) and. (3) imply that the diagonal elements of D 
in (4), denoted as ^ , are 



The classical factor analysis model for continous variables 
assumes that the response process id directly observable. In 
contrast to this model, the factor analysis model for 
categorical variables assumes that the response process y^ is 
latent and realised only as a vector of dichotomous response 
variables, x^' - (^,^ 2 , ... x ± J according to the following 
psychological mechanism:- 



13 ( 0 if y < y 



where Yj is a threshold parameter associated with item j. 
Therefore, the probability of a positive response by subject i 

to item j, given the subject's m-dimensional latent ability, 0., 

. . 1. 

13 . ■ 7 . 
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Introducing the change in the variable, 



we have 



and. when 



the model (6) can then be rewritten with slope parameters a jk 
and location parameters c fe as follows: 



/, „ ' *(t) dt 

r-i' (?) 



where 



a jk " a jk /or j (8) 
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and 



From (5V(8) and C9) t we ootain the following formulas to 
convert the slope and location estimates to factor loadings and 
threshold values: 

. o * a., /d. i 

j fe J k i. I (10) 

and 

(11) 

where 

(12) 

A guessing 0 r lower asymptote parameter 8j , can also be 
incorporated in model (7) as- follows: 

The iterative procedure developed by Bock and Aitkin (1981) 
for obtaining the parameters in the multidimensional item 
response model (7) is based on marginal maximum likelihood 
estimation, and the EM algorithm of Dempster, Laird and Rubin 
(1977). Since this approach to item factor analysis accounts not 
only for the pairwise joint frequencies of correct/incorrect 
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responsea, but also for additional information in higher order 
joint frequencies in the sample of dichtomously scored items, it 
is called "full-information" item factor analysis. 

This method is implemented in the TESTFACT program of 
Wilson, Wood and Gibbons (1984). At each step of the analysis, 
the solution from a principal factor analysis for the current 
number of factors provides initial estimates of the parameters. 
After the final estimation cycle is completed, estimated values 
are listed in the form of factor loadings and thresholds, as 
well as a set of slope and intercept parameter estimates. Th^e 
TESTFACT program provides the option for conducting a stepwise 
analysis. The chi-square fit statistics for each solution and 
the reduction from the previous solution provide a large sample 
test of significance of factors added to the model. The factor 
loadings from the f ull^inf ormation solution are rotated 
orthogonally to the varimax criterion and then obliquely to the 
promax criterion, at the option of the user. Because the 
computation of the full-information factor solution increases 
exponentially in the number of factors, the present version of 
the TESTFACT program is limited to a maximum of five factors. 

The Expected A Posteriori Estimator 

Bock and Aitkin (1981) present three methods of estimating 
ability scores; the maximum likelihood estimator (NLE), the 
maximum a posteriori (MAP) estimator, and the expected a 
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posteriori (EAP) estimator. We discuss below some reasons for 
preferring the EAP estimator. The EAP estimator for a response 
pattern is given by 

T ik " E <°ik I *i> \ 
/ 8 e k g(§) j *j XiJ (fl) [ i-Mfl> T 1 "^ de 

Z " n" 1 x iZT (U) 

Jq8(§> a ^ ij (a) [l-^ce)-) *J d e . 

•J ^ 



Rir 



In the TESTFACT program, (14) is evaluated numerically by m-fold 
Gauss-Hermite product quadrature using the nodec and weights for 
one-dimensional quadrature (Stroud and Sechrest, 1966). 

The EAP estimator is known to be biased when the number of 
items is finite. However, unlike the MLE, the EAP scores can be 
computed for response patterns with all correct and all 
incorrect responses. Furthermore, the EAP estimators can be used 
with a discrete prior in place of g(e), which is not possible 
for the MAP estimator. In order to illustrate the advantage of 
the EAP scores, we have conducted two simulation studies. 

For the first study, we generated 200 pairs ol \ 
independently and identically distributed random variables, £ ~ 
M(0,I). The two dimensional item parameter estimates oi^ the Auto 
and Shop Information Test in the ASVAB obtained by Mislfevy and 
Bock (1984) were used to generate the simulated dichotombus item 
responses to 25 items. Assuming the guessing parameter toVbe 
constant, we recalibrated the item statistics for the normal 
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ogive item response model (13). The two dimensional varimax 
factor loadings, were computed from these item parameter 
estimates. The EAP scores in the two dimensional continuum, 
which are denoted, 5, and 8 2 , were computed from the item 
parameter estimates after the varimax rotation. Twenty 
Gauss-Hermite quadrature points and weights in each dimension 
were used for the numerical integration. 

Multivariate multiplo regression analysis of the generated 
random variables 8 on the EAP estimates § was performed. Mo 
significant cubic term was detected. The regression function is 



f 9i i. r°- 012 ]. + -.r°- 954 -°-° 29 ]^, pij 

e 2 J o.ooe 1 0.036 i.oi9 e 2 1 + V 



* 2 + e 2 



The actual values of the EAP scores depend upon the particular 
choice of rotation. Nevertheless, the major and minor diagonal 
of the regression coefficient matrix became close to 1 or 0 
respectively. In other words, the EAP scores based on the 
varimax solution are essentially uncor related . This is not true 
of other methods of computing factor scores ( Harman , 1976). 

Plots of 9's and t 'sin the first and second dimensions are 
presented in Figures 1 and 2 respectively. There are noticeable 
ceiling effects in Figure 1. Since each EAP score is computed 
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based on its corresponding response pattern, the ceiling effect 
or floor effect in the EAP estimates is expected to vanish if 
additional items are added to a test or extremely difficult or 
easy Items are removed from a certain length test. The 
coefficients of multiple determination, R 2 , are 0.4513 in 
Figure 1 and 0.6054 in Figure 2. When the same simulation 
procedure descri>fed above was repeated with 500 ceses, the R 2 
dropped to" 0.4147 and 0.5660 respectively. This miy be largely 
due to the poor convergence of item parameter estimation with 
relatively small sample size. Small sample size becomes 
problematic in computing the EAP scores only when the item 
parameters must be estimated from the same observed responses. 
Otherwise, increasing the length of the tjkt leads to more 
reliable EAP scores. 



INSERT FIGURES 1 




2 ABOUT HERE 



For the second simulation study, we split a set of 30 
unidimensional item estimates of the ASVAfi Arithmetic test 
(Mislevy and Bock, 1984) into 15 odd-number items and 15 
even-number items. The 1000 dichotomous item response vectors 
for each set of 30 items were generated ^ba^ed- on the guessing 
model and the same underlying unidimensional ability 
distribution. This experiment closely simulates the situation 
in which the same group of students takes two parallel forms of 
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a test in a certain time interval. The MLE and the EAP 
estimates were computed from these sets of even-number and 
odd-number items, and they are plotted in Figure 3 and 4 
respectively. 



INSERT FIGURES 3 AND 4 ABOUT HERE 



Since guessing effects are included in the item response 
model, the ceiling effects appear in both plots. In addition to 
the ceiling effects, the plot of the MLE shows that the ability 
scores are more dispersed at the lower end of the continuum. 
This is because we cannot obtain the M!>E for extreme scores. 
The unreliablity of the MLE scores at theN lower and higher ends 
of the ability scale may be accentuated when the length of a 
test is not very long or highly heterogenous guessing effects 
are found. The comparison between the MLE and the EAP estimates 
reveals, therefore, that the EAP estimates are a more reliable 
measure than the MLE. This nature of the EAP scores is 
important since parallel forms are frequently required in 
educational testing. 

The Full- Information Item Factor 
Analysis of the School Affect Data 

The affective outcomes of schooling questionnaire that is 
analyzed in this section was developed in order to measure a set 
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of potential outcomes of schooling that might be considered part 
of the "latent curriculum". There are 40 items in this 
questionnaire, and these items were classified into four 
subscales with 10 items per scale. The specific subscalee were 
Punctuality, Honesty, Cooperation and Curiosity. The items are 
given in Table 1. The students were asked to respond with a no 
if the item did not represent their feelings or attitudes, and 
with a ves if the item, did reflect their feelings. There were 
700 elementary school students in the sample that was analyzed. 



INSERT TABLE 1 HERE 



A stepwise full-information item factor analysis was 
performed specifying a four factor solution for the School 
Affect Data. The chi-jsquare fit statistics of each solution and 
their differences are presented in Table 2. Although the 
reduction of the chi-squaro fit statistics seems to suggest that 
a model with more than four dimensions may provide a better fit 
to the data, a careful examination of the fourth factor loadings 
revealed that these loadings were minor and no interpretable or 
distinctive factor pattern was found. Therefore, we have chosen 
the three factor solution a& an appropriate model to describe, 
the behaviour of the School Affect Data. The three dimensional 
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varimcx factor loadings are presented in Table 3. 




The factor patterns in Table 3 shows that the first factor 
loadings are generally high on most of the Honeity and 
Cooperation items. The following iteo.j have noticeably high 
factor loadings on the first dimension: 

1. I know when I am being honest and dishonest. 

2. I understand that being honest is important. 

10. It is important to be honest with strangers, 
my friends and ray family. 

17. I believe that working with other students 
is more important than competing with them. 

20. I can tell when it is better to work together 
with otner students than to compete with them. 

We call the first factor characterised by the above items, 
interpersonal relations it seems to represent the interactions 
between students within the classroom. 

High factor loadings are found on the second factor for the 
following items: 

25. I try .to find out all I can about the 

subjects that the teacher talks about in class. 
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— 26 -*~~ I *« always asking qtastions and trying 
to find out more about my claaswork. 

27. Being curjio us about ny classwork is important to me. 

28. I enjoy looking for and trying out new 
ideas and projects. 

30. I have a need to know as much as possible 
about myfelf and my world. 

39 ' Bein 8 on time for class is very important to me. 

The items with high loadings on this factor come primarily 
from the Curiosity •cmJ^ J TKeYo"l terns seem to represent 
■tudentm-'^aTtitudjr toward school learning. We therefore call' 

I 

i • ■ 

the second factor;, active participation . 

Finally, thej third factor has loadings that are 
distinctively hi^h on the following items: 
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37«--f-f iniilf my classroom assignments when they are due. 
38. I turn ijn my homework on time. 

40. I finish my classwork on time, even when 
the teacher is not around. 

6. I keep my eyes on my own work in the classroom. 

The items with high loadings on this factor come primarily from 
the Punctuality scale. Like the second factor/the third factor 
seems to indicate students 1 diligence in school work. However, 
this third factor represents a more passive attitude toward 
school learning than the active participation factor, since all 
the items above illustrate students' behavior in relation to 
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assigned tasks. For this reason, we call this factor, studious 
attitude . ' 

The full-information item factor analysis provides an 
objective besis for clarifying the distinction between what the 
item writer intends to measure and what the items actually 
appear to measure. At the stage of test item construction, the 
full-information factor' analysis provides a powerful method for 
researchers to examine the construct validity of each item.: For 
example, item 13, "I do not compete with other students for good 
grades" has low factor loadings on all three dimensions. Less 
that half of respondents endorsed this item. This item also has 
low biserial and point-biaerial coefficients, 0.132 and 0.104 
respectively. In fact, the statement of this item is not 
universally considered as the positive attitude of school 
learning. In addition*, the negative wording of this statement 
may have confuaed subjects 1 responses. In this way, the 
full-information factor analysis is quite sensitive to 
ill-behaved items. 

Despite a small lack of accordance on a few items which are 
discussed later in this paper, as a whole, the agreement betwee.. 
the predefined four scales and the three major factors is 
relatively high. The Honesty and Cooperation items deiine an 
interpersonal relations factor, the Curiosity items define an 
active participation factor, and the Punctuality items define a 
studious attitude factor. As shown in Table 4, the correlation 
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coefficients between the total scores of the four original 
scales (the raw score scales), and the EAr> scores for three 
dimensions confirm this overall agreement. The raw score scales 
are simply the summation of the 0 or 1 dichotomous responses 
over the items in a specific scale, such as the items 
representing Honesty, Cooperation, Curiosity and Punctuality. On 
the other hand, the EAP scores corresponding to each dimension 
were computed based on the item response model with estimated 
slope and scale .'parameters ,. after the varimax rotation. 



INSERT TABLE 4 HERE 



Traditional d'ata analysis usually deals with the total 
score of pre-established psychological scales. The utilization 
of the EAP scores, however has advantages over raw scores for 
the following reasons: 

1. The EAP scores are computed based on all the information 
available in the subjects response patterns. Therefore, the EAP 
scores are more contlnous than the raw score scales. This high 
continuity enhances: the power of the statistical tests. The 
continuity of EAP scores can be further increased by additional 
items and dimensions. 

2. The EAP scores reflect the significant contribution of 
each item of whole test to a specific dimension or factor. On 
the other hand, each of the raw score scales reflect only a 
portion of the items in the whole test. Therefore, the raw score 
scales are subject to the potential misclassif ication of items 
from the pre-established scales. For example, item 6 states "I 
keep my eyes on my work in the classroom", and is classified as 
an item in the Honesty scale. However, this, item has a low 
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factor loading on the interpersonal relations factor and a 
rather high factor/ loading on the studious attitude factor.- 
Considering this item as equal to the othsr items in I the Honesty 
Scale may distort the conclusions drawn from further (analyses of 
the data. i 



J; AS 8h0Wn ^ n the correlation coefficients among 

the EAP scores are quite small compared to the correlation 
coefficients among raw score scales. The orthogonality of the 
EAP scores over the multidimensional space indicate* that the 
scores represent distinctive characteristics of thejsubjects . 

4. Detecting items with poor construct validity becomes 
considerably easier when we use full-iriformation factor 
analysis. Even though those items are included in the further 
analyses, the result is less affected if the EAP scores are 
used* |. 

5. The raw eeore scales are qot computable evin if one of 
the responses to the items in a scale is missing, jowever, the 

scores can be computed regardless of missing responses. 
Actually, as shown in Table 5, the raw scores of 50 subjects 
were excluded from the further data analysis because of their 
missing responses. | 



INSERT TABLE 5 HERE 



Discussion of Multivariate Analysis 
of Raw Scores and EAP Scores 

In order to illustrate some of the advantage^ of the EAP 
scores over the use of raw scores, a multivariate janalysis of 

variance was conducted using each type of score, i 

i 

Two major factors were included in the analysis. The first 

factor is grade level, and the second factor is the sex of the 

i 

student. The grade level gives an indication of the effect of 
quantity of schooling on the affective outcomes of schooling. 
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The sex of the student. was included because there has been 
evidence that girls and boys may be learning different lessons 
in school • 

The cell and marginal frequencies for the sample based on 
the results of the raw scores are given in Table 5. The observed 
cell and marginal means are given in Table 6. The cell and 
marginal frequencies for the EAP scores are given in Table 7, 
while the observed cell and marginal means for these scores are 
given in Table 8, The sample size for the raw scores is 650 
because 50 of the students had missing responses to one or more 
items, while the sample size for the EAP scores is 700. 



INSERT TABLES 6, 7 AND 8 HERE 



Table 9 provides a summary of the univariate and 
multivariate analysis of variance for the raw scores. There are 
no significant interactions between grade and sex for the four 
dependent variables. Grade level has a significant effect on 
Cooperation and Curiosity, but not on Honesty or Punctuality. 
Overall, there appears to be an increase in the students 
reported levels of Cooperation, and a decrease in their 
Curiosity during elementary school. The sex of the student has a 
significant effect on Honesty, Cooperation and Punctuality. The 
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girls have higher means on all of the scales. Although there are 
no significant interactions between grade level and sex, an 
examination of the cell means suggest that there may be slight 
differences iu the patterns across grades for girls and boys on 
the cooperation scale (p<. 0869). The boys show a clear decline 
from grades 3 to 7. The girls appear to become les« cooperative 
from grade 3 to grade 5, and then to report that they become 
more cooperative from grade 2 to grade 7. It would be 
interesting to examine this da±a for cubic trend across grades 



INSERT TABLE 9 HERE 




The resulta for the univariate and multivariate anaSUsis of 
variance for the EAP scores are summarized in Table 10. The 
are no significant interactions for the grade level or sex 
effect for the EAP scores. Grade level has a signifant effect on 
tne interper sonal relations factor and on the active 
participation factor, but not on the studious attitude factor. 
An examination of the marginal means by grade level indicates 
that the students show a increase on the interpersonal relations 
factor, and a decrease on the active participation factor . Sex 
has a significant effect on all three factors, and the girls 
have higher levels on each. 
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INSERT TABLE 10 HERE 



In comparing the results of the analyses based on the EAP 
scores and the raw score*!, there appears to be a reasonable 

o 

amount of agreement. The similarities between the two analyses 
is related . to the amount of agreement between the a priori 
classification of the items into the four scales, and the 
results of the full-information Item factor analysis. $ 

It is also of interest to note that the p-values are 
smaller for the analyses ultfig the EAP scores which indicates 
that the statistical tests are more sensitive with the EAP 
scores. This is relate'd to the increase in the information that 
is availabe by using all the data\available in the response 
patterns which is not used when raw scores are analyzed. 

In summary, the interpretation of the multivariate analysis 
is simplified with the EAP scores where there are fewer concepts 
to discuss. The orthogonality, of the EAP scales also facilitates 
the interpretation of the results, since they represent a better 
index of the constructs. The EAP scores better reflect what the 
test items actually measure, and they are sensitive to test item 
behaviors. Therefore, the construct validation of the 
psychological measurement based on the full-information item 
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factor analysis is strongly recommended in the initial item 
preparation stage. 
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Table 1 

Affective Outcomes of Schooling Items 



Honesty 



Cooperation 



I know when I am being 11 
honest and dishonest. 



I understand that being 12 
honest is important* 



3 I know that cheating 13 
on classwork is wrong. 

4 I do not copy answers 14 
from other students. 



I tell the truth when 15 
questioned by the teacher. 

I keep my eyes on my own 16 
work in the classroom. 



7 Being honest, is very nr "'' 17 
important to me. v 



8 I am honest in the 
classroom, even when 
the teacher- is not around. 



18 



Being honest can lead to 19 
good and bad things. 



10 It is important to me to 20 
be honest with strangers, 
my friends and my family. 



I know that in some things 
working with other students 
can be better than working 
alone. 

I know when to cooperate and 
when to compete with my 
classmates. 

I do not compete with other 
students for good grades. 

I help other students who 
do not understand their 
classwork. 

I work with my friends on 
my homework. 

I get along with other 
students when we are working 
together in a group. 

I believe that working with 
other students is more 
important ti.an competing 
with them'. 

I enjoy working on projects 
with other students. 



I believe that if my class- 
mates and I work together 
that most of us could get 
good grades. 

I can tell when it is better 
to work together with other 
students than to compete 
with them. 



Note . The students responded with a no nr yea each -h-awi, 
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Table 1 ( Cont .) 
Affective Outcomes of Schooling Items 



Curiosity 



21 I know that learning 
about new things is 
important , 



Punctuality 



23 



24 



25 



26 



27 



I know how to find out 
about anything I may 
want to know. 



I ask questions when 1 1 
do not understand what my 
teacher is doing, I 

I try to find out all I 
can about the subjects 
that the teacher talks 
about in class. 

I am always asking 
questions end trying to 
find out more about 
my classwork. 

Being curious about my 
classwork is important 
to me. 



28 I enjoy looking for and 
trying out new ideas 
and projects. 

29 I get excited about the 
topics discussed in my 
classroom. 

30 I have a need to know as 
much as possible about 
myself and my world. 



31 I know that I am exacted 
to come to class on time. 



22 My classroom offers me 32 
a wide variety of things 
to do and learn. 



I understand why being on 
time for class is important 



33 I know that my classwork is 
" due at a certain time. 



34 I am in my seat when the 
bell rings in the morning. 



35 I try to come to class 
on time. 



36 I am ready to begin class 
when the bell rings 
in the morning. 



37 I finish my classroom 
assignments when they 
are due. 

38 I turn in my homework 
on time. 



39 Being on time for class 
is very important to me. 



40 I finish my classwork on 
time, even when the 
teacher is not around. 



Note , the students responded with a no or ves to each item. 
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Table 2 

Reduction in Chi-Square Fit Statistics 





Adding Factor 


Reduction in 


Degrees 




Chi-Square 


of 






Freedom 


Second factor 


349.04 


39 


Third factor 


259.25 


38 


Fourth factor 


171.35 


37 



3 

• J 
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Table 3 

Variroax factor Loadings for the Three Factor Solution 



1 

t 

1 

1 

i 

Scale 




Item 


1IU CCJIIOXU 


r ir si 


factors 

G A 4* A M 41 

pecona 


x flira 


... 

Honesty 


1 

X 


-1 .564 


595 


- oil 

••MIX 


07A 




2 


-1.643 


.500 


.253 


.160 




3 


-1.361 


.329 


.262 


.195 




4 


-.230 

• •» W W 


.278 

• Xj # U 


- 028 


1 1 A 




5 


-1.001 


. 244 


.229 


.407 

t T W r 




6 


-.967 


.131 


.241 


502 




7 


-1.432 


.412 


.371 

• W f X- 


. 343 

• W *"Y W 




8 


-.566 


.253 


.317 

• W m* « 


.465 






-1.164 


'.- .283 

• mm Wjmt 


-.051 


. 097 

• W 7 9 




10 


-.860 


.512 

• W A •# 


.066 

• www 


• ^w 7 

t 


Cooperation 


11 


-.75? 


.454 

• ~ W^ 


.024 


.020 




12 


-1.113 


.348 


.252 


.134 




13 


.238 


.095 


-.212 


.169 




14 


-.848 


.303 

• www 


.152 

• X *J ,mm 


v 254 

• Mm *mf*+ 




15 


. 197 

• x ^ f 


.208 

• mm w W 


-.006 

• WW w 


- 084 

• w w~ 




16 


-1. 113 


.431 

• ™ w * 


-.009 

• WW J 


. 152 

• X «S X* 




17 


-..801 


.541 


.032 

. • W W mm 


.116 

• X X w 




18 


- . 988 


.249 


1356 

• www 


060 

• www 




19 


-.660 

■ WW w 


.267 

• <M W * 


. 164 

£ X w ~ 


-.109 

• * w ✓ 




20 


-1 .088 

• •WW w 


.487 

• "T w » 


21 9 

• X* X 7 


279 


Curiosity 


21 


-1 .815 

A • w X 


-219 

a *» X 7 


321 

• *J mm JL 


357 

• w w r 




22 


-.591 


.146 


,.340 


.172 




23 


-.519 


.069 


^258 


.094 


■ - - - - - 


24 


-.945 


-.021 

• Ww X 


494 


052 

• V w x* 




25 


-.633 

• W W W 


-.101 

• X wX 


. 703 

• f w *J 


100 

• A WW 




26 


-.181 


-.116 


.612 

• W X Xi 


- 018 




27 


-.846 

e w ^» w 


.136 

• X 4g# W 


.541 

• W X 


.125 

• X x> «■# 




28 


-.954 


161 


• JO J 


097 




29 


. 210 

• A* JL w 


-.087 

• W W f 


437 


017 

• w X f 




30 


-1 .225 

m* % mm mm *J 


. 157 

• A w # 


519 


217 

• mm 1 9 


Punc tualitv 


31 


-2.062 

m* • w w X* 


262 

• mm KM 4k 


225 


292 


32 


-1.267 


.271 


.497 


.252 




3? 


-1.473 


.425 


.220 


.231 




3* 


-.525 


.320 


.158 


.385 




35 


-1.791 


.272 


.372 


.203 




36 


-.824 


.196 


.401 


.431 




37 


-.731 


.015 


.015 


.838 




38 


-.906 


.208 


.105 


.802 




39 " 


-1.065 


.256 


.509 


.399 




40 


-.448 


-.002 


.061 


.855 
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Table 4 . ^ u 

Correlations of Raw Score Scales and the EAP Scores 
(Sample sizes in parentheses) 

; v — ; ^ • 



HO 



CO 



cu 



PU 



EAP 



EAP 

3 2 



EAP 



Honesty 


1,000 

(68*/) 












> 


Cooperation 


.331 
(670) 


1.000 
(678) 




• 








Curiosity 


.272 

(667); 


.191 
(660) 


1.000 
(67» 










Punctuality 


.455 
(681) 


.254 
(672) 


.324 
(667) 


1.000 
(688) 








EAP 3 1 


.617' 
(687)-„ 


.751 
_i678) 


.098 
(672) 


.306 
(688) 


1.000 
(700) 






EAP 82 


.302 
(687) 


.196 
(678) 


.910 
(672) 


.353 
(688) 


.161 
(700) 


1.000 
(700) 




EAP $3 


.470 
(687) 


,148 
(67?) 


.152 
(672) 


.823 
(688) 


,143 
(700) 


.094 
(700) 


1.000 
(700) 
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Table 5 

Cell and Marginal Frequencies for Total Scale Scores 



Sex 



Grade Boys v Girls Total 



3 91 104 195 

5 132 112 244 

7 106 105 211 

Total 329 321 650 



Table 6 

Observed Cell and Marginal Means and Standard Deviations 

of Raw Score Scales j 



Sex 



Bovs | Girls 



Grade HQ j CO , CU PU HO - CO CU PU 

3 8.187 71000 7.978 8.330 8.519 7.846 8.385 8.673 
(1.61) (1.65) (1.69) (1.50) (1.59) (1.41 j '(1.32) (1.46) 



8.258 



7.106 7.242 8,273 8.652 7.313 7.366 8.598 



(1.54) (1.92) (2.00) (1.93) (1.44) (1.71) (1.95) (1.70) 



7 8.340 


! 7.528 


7.066 


8.160 


8.686 7.74<3 


7.029 


8.524 


(1.58) 


(1.51) 


(1.95) 


(2.18) 


(1.40) (1.'73). 


(2.24) 


(1.78) 



Marginal Means by Grade Level 

Grade HO CO CU PU 

11 ' i ■ • i 

3 8.364; 7.451 8.195 8.513 
5 8.439 7.201 .7.299 8.422 
7 8.512 7.635 7.047 8.341 
Marginal Means by Sex 
Sex HO CO CU PU 

Boys 8.264 7.213 7.389 8.252 
Girls 8.620 7.626 7.586 8.598 
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Table 7 

Cell nd Marginal Frequencies for The EAP Scores 



Sex 

Grade Boys Girls Total 

3 10O in 211 

5 141 123 264 

7 117 108 225 

Total 358 342 7010 




\ 



\ 

\ 
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TaHe 8 

Observed Cell and Marginal Means and Standard Deviations 

of The EAP Sdores 



Sex 





Boys 


i 

Girls 


\ 

\ 




Grade 


*v ~* 

8i e 2 e 3 


8i 


\ 

♦V 


e 9 


3 


-.277 .194 -.097 
(.779) (.770) (.717) 


.049 

. \ * OD J ) 


.401 
( • 007 ; 


.047, 
( .731^ 


5 


-.171 ^.145 .025 
(.750) (.865) (.759) 


-.010 
(.762) 


-.017 
(.831) 


.148 \ 
(.809) \ 


7 


.168 -.212 -.121 
(.674) (.858) (.895) 


.290 
(.706) 


-.184 
(.924) 


.029 
( .886) 


Marginal Means by Grade Level 








Grade 


§1 $2 $3 








3 


-.106 .303 -.021 




'» » 

' \ 




5 


-.096 -.085 .082 




\ 




7 


.227 -.198 -.049 




V 




Marginal Means by Sex 








Sex 


01 .9*2 $3 








Boys 


-.090 -.072 -.057 








Girls 


.104 .066 .078 
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Table 9v 

Univariate and Multivariate Analysis x>f Variance (Raw Scores) 





Or 


Dep. 
var . 


CO 
OD 


Univariate 
F p. less than 


Multivariate 
* p less than 


Constant: 


1 


HO 


46301 840 












CO 

VA/ 


35756 Q86 












ph 


36A97 695 














46116.346 








Grade, eliminatina 


2 


HO 


2.213 


.476 


.6215 


\ 239 .0001*** 


wVllOUCIIlU . ^ 




CO 

ww 


21 666 

4.1 • UUU 


3 866 

«J . www 


0215* 

. V4bX«J 


V°> *^ozy 






eft 


147 0Q5 

X*t f |U7J 


90 537 

ZU« J^/ 


0O01 ### 

. wWX " " " 








PU 


2.984 


AA7 


A973 

. OZ # J 




Sftic elimlnfltHno 
we* | cjLxiuxiiauJbiig 


1 


HO 


20 Q7Q 

4b V/ • 7 # 7 


9.026 


.0028** 


1 6A0 0057** 


<>onscanc at ursae 




PO 


96 015 


O 9AA 

V . ZCW 


009 S## 


/'A 6A1^ \ 






PIT 


3 03A 


1 100 
X . xvv 


9QAA 








PU 


19.069 


5 OA A 


01 AtHfr 
• U1*W^ 




a1 4m4 nal*4 via 

oeX| eiuninacing 


1 
1 


wn 
nu 


90 S3A 
ZU . jjf 


8.834 


.0031**\ 


3 762 0050** 

«J . # W4& . W W-# W 






ro 


27 767 


q ono 

7. 7V7 


001 A## x 


\ C4 641^ 






ptt 


6 9A1 
O. ZOl 


1 7SA 


1A5Q 


\ 






PU 


19.434 


A HAH 
O.UOU 


m An# 


\ 

\ 
\ 


Grade, eliminating 


o 

Z 


nu 


9 ASA 


.572 


.5648 


\ 

7 lQ5 0001*** 


uca a wonsuanc 




pn 




1 553 


' 09Q9# 
. UZ 7Z w 


/Q 19fi9^ 






pit 


1AA 759 

W| / jZ 


90 910 

zu. ziu 


. uuux 


■ \ 






PU 


2.619 


A10 

.HXU 


" AAA1 


\ 

-Iv 


Grade & Sex, 


0 
4b 


HO 


11ft 

. xxo 


.025 


.9750 


AA99 53 N 0A 

. OOZZ . jJUO 


eliminating ail 




pn 


1** 7A«\ 


9 AS3 


nAAO 
• U0U7 


^A 19A9^ 


main ciicCuS 




PTT 


5 AAA 


71 n 

. /1U 


Ad91 

.t?7Zx 








PU 


.041 


nnA 
. uuo 


0047 


\ 


uroup neans 


ft 


wn 
nu 


AA395 150 






-H— . 




p/i 


35A1A A19 












PIT 


qACoo 7AA 












PU 


46138.440 




ft 




Within Groups 


644 


HO 


1496.850 










CO 


1804.588 












CU 


2306.256 












PU 


2058.560 








Total 


650 


HO 


47822.000 


*MillWtllHil»^l 










CO 


37623.000 




* .05 


> p > .01 






CU 


38890.000 




** .01 


> P > .001 






PU 


48197.000 




*** .001 > p 



ERJC « 34 



Table 10 

Univariate and Multivariate Analysis of Variance (EAP Scores) 



Source 



DF Dep. 
Var. 



SS 



Univariate Multivariate 
F p less than F p less than 
(DF) 



Constant 



Grade, eliminating 2 
Constant 



Sex, eliminating 
Constant & Grade 



9% 
h 

ei 
e 3 

e 3 



Sex, eliminating 
Constant 



Grade, eliminating 2 
Sex & Constant 



I: 
fc 

6s 



Grade & Sex, . 2 
eliminating all 
main effects 



8 2 

e 3 



Group Means 



Within Groups 694 



Total 



700 



6i 

e 3 
e 2 

e 3 



.016 
.015 
.056 

16.322 
30.125 
2.360 



14.321 .0001*** 15.120 .0001*** 
22.482 .0001*** (6,1384) 
1.832 .1609 




12.031 .0006*** 
3.723 .0541 
5.147 .0236* 



5.499 .0010** 
(3,692) 



11.519 .0008*** 
4.976 .0261* 
4.895 .0273* 



5.563 .0009*** 
(3,692) 



16.614 
29.285 
2.522 

1.277 
.892 
.024 



14.577 .0001*** 15.082 .0001*** 
21.856 .0001*** (6,1384) 
1.958 .1419 



1.121 .3267 
.666 .5144 
.019 .9816 



.5302 .7857 
(6,1384) 



24.471 
33.526 
5.755 

395.483 
464.951 
446.969 

419.954 
498.477 
452.724 



* .05 > p > .01 
** .01 > p > .001 
*** .001 > p~" 
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